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1. Introduction 

Let X, = {Xf,, . . . , X„ y be a point set of independent 
identically di.stributed J-dimensbnal random vectors 
sampled from the probability mea.sure fi, and AT be a 
punctured at the origin cone in R^ rf > 1 . Wc define the 
kth layer as 

^*'(5Sf.) - <X- # {Kx, n X) =/:-! } A: - 1.2 



where Kj, = x+K is the translated cone with vertex in 
.t E R**. Intuitively, the ^th layer is the set of the /:th 
extremes of ^, in the direction K. The prime examples 
wc have in mind arc (1 ) the Pareto-optimal points corre- 
sponding to the first layer in the direction of the positive 
orthani, and (2) the total maxittium, which may be con- 
sidered as the first layer in the direction of the cone, 
complement to the negatire orthant. We are interested 
here in the distributions of random variables 



«). 



#^*'(%), 



counting the number of points in the ^th layer. These 
distributions depend essentially on both K and fj, . 

From a more general viewpoint, the first layer can be 
regarded as the set of maximal elements[A\ with respect 



to the binary relation St in R'' defined as yMy <i=> x- 
y G ^.Alternatively, any scale and translation im-ariant 
binary relation generates a cone by setting K -^ {x^ R**: 
jr5?0} and the maximal elements are conical extremes. 

Two above cases of the counting problem ha\'e been 
considered in the literature under the a.ssumption that fi 
is either a product of one-dimensional marginal mea- 
sures or a multivariate normal distributbn (2,10, 1 1 ,12]. 
It is well known, for example, that if /x is a product 
measure in R** then Ihe average number of Pareto points 
is of the order of (log n )**"', while the probability thai the 
multiple maximum exists is n '"^. 

In this paper we focus on a class of distributions fx 
already studied in connection with multivariate ex- 
treme-value theory [8] arxl statistics of convex hulls 
[1,5,6,9]. These distributions are characterized by regu- 
lar variation of the tail of the radial component and 
asymptotical independence of radial and angular com- 
ponents. We show that typically the V„'**'s converge in 
distribution and the expectations have finite limits as 
« — > 3c. In the special case of slow variation wc calcu- 
late explicitly the limiting distributions. 
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2. Preliminaries 

We define a cone as a punctured at the origin, scale- 
invariant Bore! set in R'', i.e., O^K, iK=- K '^t>0. 
Each cone Ls uniquely determined by its spherical base 
S,.^K n S , where 5 denotes the unit sphere. Wc asso- 
ciate with K also the spherical set 5. obtained by reflec- 
tion about the origin, So-S\ (S^ U 5.) and S^'=S^r\ S.. 
The cone with spherical base CCS will be denoted 
cone (C). 

Set B,"{x^R'':\\x\\^r}, flJ-RAS, and 
i4,.c-COne (C) D Bf. 

We fix in what follows a cone K and a multidimen- 
sional probability distribution ft satisfying Ihc following 
conditions: 

(i) There exists a > and a probability measure p on 5 
such that 



hm ,„„ - r" 



r>0. 



(I) 



(ii) For all /^-continuous C (Z S 



(iii) p (int S^) > 0, and 



lim 

I— >00 



P(C), 



(2) 



(iv) fjL has no atom at the origin. 

Consider an iid sample from p., 3¥„- {X^- . . ,X„}, 
represented in the polar form as the product of radial 
and spherical components: Xi = RiZi, where /?i = ||Xi!1, 
Zi=-Xi/|[Xi|]. The above conditions on ^t have a natural 
probabilistic interpretation. Condition (i) means that the 
distribution function of the radial component, 

f (f ) t' /I (BX 

has a regularly varying tail. Condition (ii) is translated 
as 



lim P{Z, 



|«,>r} = p(.) 



and Ls to be interpreted as the asymptotic independence 
of radial and spherical components, where the limiting 
distribution p does not disappear in the interior of 5^ 
(condition (iii)). The last condition is not essential and 
assumed for technical reasons. 

Given a Borel set iJ C R"* , we represent the number 
of the it th layer points in 5 as the .sum of random indica- 
tors 

n 

#.2*'»(%nfl) = 2 lfx,ey<"(*',,nm, 



and using the iid assumption write for the expectations 
E#,SP'*'(5r. n B) - nP{X, e i!?*'(X) r\B}- 

n("."[)p{X,Gfi;X3 X,^K,^:X,^, X,^K,,;)= 

«tl}) / (t^{li,)t\\-lx(K,)r' dp(.r) . (3) 

The following lemmas will be used to estimate these 
integrals. 

Lemma 1. There exists t> such that p.{Kj) > 
T(l-n(Bt^)for all x^R" . 

Proof. Consider first the case where there exists a 
linear isomorphism which maps K onto the positive 
orthanL Let y be the inverse image of the vector 
(l....,I) under this isomorphism. By convexity, 
/:, C A'^forallArGB,. 

Condition (iii) allows one to select a compact p-con- 
tinuous set CC 5+ with p (C)>0 . It is easy to see that 
y G int K, the sets K,y, s>0, arc increasing as j 4- and 
U,>o /fj> = int /T. It follows that C C /f„ for sufficiently 
small 5, Furthermore, for small s wc have also 
Ai_c C K:^. Indeed, the points of A|.c are rcpresentable as 
tx , with / > l,x E.C, tlius, by convexity, x E K,, im- 
plies tx G K,„ C Kty. Homogeneity implies A^j^ C K^,. 
it follows now from Eqs. (1) and (2) that 

MB';) ^ ti{Bt) ~ MBk) MBT) 



s-piC). r~^» 



(4) 



From Kj D K-,^^ wc derive for sufficiently large rn and 
lUI > rn that 

For X ^B,gVJC have Kx D K^^ , therefore Eq. (4) along 
with the inclusion K,re,y D Kr,^,, t > 1, implies 



MK.) fJi(f(r„r) 



> fJ.(K,„y)> 0. 



The assertion follows in this ca.sc by selling 
T-min(/i(/f,„,),^rp(C)). 

For arbitrary K one can find a smaller cone K' CK, 
which is linearly isomorphic to the positive orthant and 
still has the interior of its spherical base of positive 
p-measure. This is possible since the spherical J-sim- 
piexcs build a measure-generating class on S. It remains 
to note that p(Ar.t) S p(Arj) for any translation, whence 
the estimate holds in general. D 
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Lemma 2. //E V;,''' has a limiting value v E I0«) 
then all EV„**\ k - 2,3, • • . converge to this limii as 

Proof. Lctm(0. f S [0,1], be the distribution function 
of the image measure induced by the mapping 
jrt-*/x(/k^). Changing variables transform Eq. (3) to the 
one-dimensional Lebesgue-Stiltjes integral 



EV<i> = n(j_j)j'r*-'(l-0"^d,«(f). 



A slight modification of the standard Tauberian theorem 
as found in [14] assures that the limiting value of this 
integral for Jt- 1 exists iff m(f) is left-differentiable at 
f - 1 , in which case the limit and the derivative ha\'e the 
same value. Applying this theorem in the reverse direc- 
tion one can easily see that all the EV„'*' 's must have the 
same limit. D 

Lemma 3. Assume y, is an increasing sequence such 
that lim nO-F (■Y^})-iy, y>0 , then 

limsupEV'^^T', (5) 

n— >3c 

lim sup E # (.S?"(5«;) n 5,„) * e ^t"', (6) 



with r determined by Lemma 1, 
Proof. Set 



Similarly, 






dF(r), (£[0,1). 



Fin * ' 



Regular variation of F at infinity implies readily that for 
all sufficiently distant discontinuity points the ratio 
(jump-sizeV(distribution tail) is close to zero. It follows 
that (l-/(f))/tl-0-*l as / T 1 (for continuous F this is 
obvious since /(r) = r ). Lemma 1, a change of variables 
and the Tauberian theorem yield 

EV/" = /!f (]-M^.)r'dMU)« 
nf (I-T(l-/i(%)r'dM(jr) = 
[ (l-T(l-F(r)r'dF(f ) = f {l-T(l-f)r'd/(rM7-'. 



!imsupE#(i!?"(%,)nS.)=£n( (l-T(l-F(r)r' 
n-?^ Jo 



dFir)~ 



rn-r.) r" 

n (l-T(l-r)r'd/(/)~n ( 

Jo Jo 



r)r'd/(/)~n (l-T(l-r)r' d/ 



^e ^T"', 



where the equivalence can be justified by partial integra- 
tion. □ 

3. Pareto-I^ils: a > 

In this section we study the limiting behaviour of V„'*' 
under the assumption that the regular variation index a 
in Eq. (1 ) is positive. Our plan Ls to translate Eqs. ( 1 ) and 
(2) into the convergence, of a suitably normalized sam- 
ple, to a PoLsson process[6, 1 5] and then apply a continu- 
ity argument to prove also the convergence of the 
V,<«'s. 

Compactify R** by adjoining the infinite point == and 
then puncture in the origin. The resulting topological 
space, say R"*, is isomorphic to R"* and canonically em- 
bedded into its compactification, bounded from die 
origin Borel sets B C ft"* being relatively compact. We 
endow the space A/(R'') of Radon measures with the 
vague topology: m„ -^ m iff m„{B)—imiB) for all rela- 
tive compacts. 

There exists a sequence of positive constants a„— >3c 
such that the measures v^i-) S nfi(a,-) converge 
vaguely to the measure v determined by 



K>l..r)-'-"p(C), H{^})-0. 



(7) 



The limiting measure is in A/(R^) , being infinite on 
balls centered at the origin as well as on the sets 
cone (C) with p(C) > 0. In particular, condition (iii) 
implies v (intK) = ^, Clearly, i' is a product measure in 
polar coordinates and has no atoms. 

Let ^be a Poisson point process in R"* with intensity 
measure v, and ^ be the random element of Af (R") 
associated with the scaled sample a^'3€,. Obviously, the 
operation of taking a layer commutes with rescaling: 
a:^^\aK) - a^^XK), a > 0, therefore the number of 
points in each layer remains invariant under scale trans- 
formations. One can expect in this situation that V,'*' 
converges in some sense to an analogous fiinctional of 
the Poisson process. 

Define the A Ih layer of the Poisson sample as 

^"(f ) = U G R" : ^ ({X }) = 1. ^ (K.) ^k-l}, 

and denote V'*' = #ii?"(^) the number of points in the 
klh layer. 
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Using the polar represeniaiion, -r = rz, and homo- 
geneity we can wriie v{K,) = ^""^(z), where i^(z) = 
ifATJ is a function of the spherical argument, Using 
Palm probabilities and integrating along radial rays we 
represent the expectations as 



^Y 






w 









(ifix) = 



^-''*it) 



.Ar^M^ 



(k-l)! 



-dpa)d(-0' 



I 



dpCz) 

0(2) ' 



(8) 



The resulting integral does not depend on it, a.s it is 
suggested by Lemma 2. The integration area can be 
reduced to 5Nint 5 since <t> is infinite on int S.. 

The following lemma is found in [5]. 

Lemma 4. Let Ebea locally compact, Hausdorff and 
separable space; hn.hi,,. .be a uniformly bounded 
sequence of real measurable functions commonly 
supported by a relatively compact set; and mn, /«!,... 
be a sequence of Radon measures on E such that 
m„ -^ mo- The set D" {x^ E :3{x„}, .v.— »jf, h„(x,) 
-h hix)} is measurable and if m^D)= then 
J hjm„ ->/ hadmo. 

Now we are ready to prove a convergence result. 

Theorem 1. Assume (i)-(iv), a > 0, and 

vi-^fi) - 0, (9) 

vX w{(x.y) G R^xk" : (x-y) G ^ AT } = 0. (10) 
Then for all k ^ 1 ,2, . , . 

{vT,....04(v*'>....v'"). (11) 

Ey<i'-^EV'*\ n^K. (12) 

Proof. By Skorohod's theorem we can find random 
point measures |,,f€M(6'') satisfying |, = ^„, 
^ = f and i„-^ ^ a.s. Thus to prove the convergence in 
distributbn (10) it suffices to consider the case ^ -^ ^ 
a.s. In what follows wc fix. a typical realization of ^ and 
assume n sufficiently large. 

Since i-CInt /f)=^, f lays in the cone interior 

infinitely many poitits. Select k of them, say jT] Jt*. 

Pick r sufficiently small to satisfy B, C Oj.i ~Kx, a.<i 

well as f (^B,) = and also tf, H {.tj, j* } = 0. The 

complement flj is relatively compact hence the 
processes ^ and ^havc there a finite number of points. 



say y„.i y,^ and y y^ respectively. These 

points may be labeled so thaty;,j — * y, . as it follows from 
the vague convergence. By the construction, any trans- 
lated cone /fj with jc G B, contains at least k points of ^, 
thus .B,ni?J\O = and also a.n^^^)-© for 

;=i k. 

For yi G -int K , the cone Ky. contains a vicinity of the 
origin, where ^ has infinitely many points. Therefore 

y,^n*,,i?*my„,enf.,^*'(^). 

The condition shown in Eq. (9) assures that no one of 
yi, . . . ,yp lies on -3K. almost surely. 

For >■( ^-clK, the shifted cone K,^ is bounded from 
the origin. Therefore there exists an open vicinity of 
cKUf^ 1 Ky) which is still relatively compact, and hence 
contains at most a finite number of points in addition to 

y, J-p - By Eq. (10), ((dKy^) = a.s. Again the 

poinwise convergence implies f (^t„J — 

€{Ky,). whence (V.'" V,'") - (V" \/(")'"and 

thus (11). 

Now turn to the convergence in mean. It Ls enough to 
prove Eq. (12) for the first layer, it — 1. It Ls easy to see 
that 

EV„<" - j exp{-i'„iK.))di'„{x) = I ( . . . )d.'„+ 



I 



(...)di', r>0 



Take a point x € -cl fC and a sequence jc„ — * jr and 
consider the indicator functions of the sets /G and K^^ as 
the h's in 1-emma 4. The divergence set D is (fKj,, 
whence by (9) and the lemma v„ (K^J -* viKJ. 

For X G -int K, x„—fx we have i',(Ar,J to viK^) = °o 
since ^^„ cfmtains some fixed vicinity of the origin,for 
all sufficiently large n. Therefore in this case also 

To make further use of Ixmma 4, consider this 
time the functions /io(jf) = exp(-r'(/^j)), h„ix) = 
cxp<i-v(Kj,^)). For the discontinuity set we have D C 
-,9/f U {;r : v(/}K.) > 0>. The assumptions in Eqs. (9) 
and (10) imply v(D) = . hence for any r 

I exp(-i/,(A'J)dr,(j:)-> | <^p{-u{K,))diU). 

Now apply Lemma 3 to derive the estimate 

limsup exp(-f„(K'J)dv„(.r) «T 'cxp(-i/(B;)T). 

The right-hand side here tends to zero as r-^O. 

Putting this all together and comparing with Eq. (8) 
wc conclude 

lim sup EV'i' « EV<". 
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The reverse inequality, 

tiniiiifEV,">>Ey"\ 

follows from the convergence in distribution D 

Remark. The continuity conditions of Eqs. (9) and 
(10) are actually some properties of the spherical mea- 
sure p. The first one trivially translates as p {-flK) = 0, 
but we have not been able to find a re-formulation for 
the second. Sufficient conditions for Eq. (10) are: p is 
non-singular, and ^S, lies in a («— 2)-dimcn5ional set; 
or AT is convex, SK has no two-<limensional facets and 

p{as.) = o. 

Example. Here is a remarkable case where the expec- 
tations are explicitly computed. Consider the two- 
dimensional Cauchy distributbn specified by the 
density dAt(jr) = (2fl-r'{l+|}i||;-"'djr. x G Tt\ The 
radial tail is regularly varying with or = 1 and the circu- 
lar measure is uniform, i.e., dv (re) - {2it )"'r 'drdz, 
r > 0, z G 10,277). 

Assume first that K is the positive quadrant The kth 
la^'er arc those X; 's which are exceeded by exactly k— 1 
points of % in both components. Integrating yields 



, , . ,„. cos ; +sin z -1 ^, ,_ . 

<t){z) - HK^J = -^ ■■ z e (-7r/2, tt) 

27rsm zcos z 



and (l>(z) - ^ otherwise. Computing the integral in 
Eq. (8) we obtain 



lim Ey,»'=l +^. 



The first layer is either empty or just one point, maxi- 
mizing both components, thus this mean value coincides 
with the limiting probability of the total maximum. 

The limiting distribution and higher moments of the 
V'*' 's can be, in principle, expressed in terms of some 
integrals similar to Eq. (8). These expressbns do not 
seem tractable by analytical methods because of the 
complicated integration domains. 



4. Slowly Varying Tails: a =0 

The case of slowly varying radial tail, with a = in 
Eq. (1), is of special interest. The above Poisson approx- 
imation method does not work, since the sample cannot 
be rescaled to provide a non-degenerate limit. To get 
around, we extend here a method already exploited in 
[I J, where the number of convex hull extremes of a 
sample under slighly stronger assumptions on the 
distribution has been studied. 

We assume for technical reasons that F is continuous 
though, in fact, slow variation is all that is needed. 

Let X^i,\ . . . , X';' be the elements of X arranged in 
the norm-decreasing order, i.e., |JX';I' || > . . . > ||X';' ||. 
SetRi^l = ^; and Z'i' = Z;, iff X'^' =X;; /,;- 1, . . . , n. 
One can recognize in the /f '^' 's the radial order statistics. 
The associated spherical variables, Z'i' 's will be called 
concomitants. Note that the continuity hypothesis make 
the definitions correct since the radial components are 
different with probability one. 

Mailer and Resnick [13] proved that sbw variation is 
equivalent to 






J^O 



1,2. 



(13) 



For it= I we have the Umiting mean of the number of 
Parcto pomts. 

Now suppose K is the complement to the negative 
quadrant. The kth layer consists of those Xj's which 
exceed all except some k-l sample points in both com- 
ponents. We get 



Our convergence results effectively exploit this fact 
combined with the asymptotic independence of the con- 
comitants shown next. 

Let Z'", Z'"', ... be iid S-valued random variables 
with distribution p. 

Lemma 5. Assume thai F(.r) = ti{B,.) is continuous 
and Eq. (2) holds. Then 



cos ; + sm z +1 _ 

(^(z) = --z : 2 e (0,7r/2) 

27T sm zees z 



and ^(i) = «: otherwise. Computing the integral Eq. (8) 
in thk ca.se, we obtain 



lim EV,<«=I-^. 



(Z 



Ml 



,Zl*')A(Z"' Z'") A =1.2, 



Proof. For p-continuous CCS write (2) as 



lim 

y-)3 



I-F(r) ■ 



P(C), 



(14) 



where Fc(r)~ p.{conc(C) H B^). Sekct arbitrary 
k G N and p-continuous spherical sets C , C*. 
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We have 



P{2'^'GC, Z'i'GQ}- 



(n-k)\ 
P{2i^i G C„ X'^' = X,, . . . , z'*' e c*. xw = 



x.}= 



(«-*)! 



P{Zi^'GC,,ft'^' = ff„..., 



zi,"ec*,^'»*' = Ki}' 



■p{z>^iec,..... 



Z'i' G Cji,/?,> ...>/?*; «i > «f for i" " it+I, ... , n } - 



(n-fc)! 



/ 



(/^(/■*)rMAt(r,!,) . . . dAt(AZt) = 



r,>...>r, 
. eC, iECl 



ri > . . . >(■■ 



Fl. . . . 'j I > 'I 



"U(i<--r<-')~"t;)f<->- 

(for large r uniformly in n) 

dFc^(rt) + e -» piC) . . . piC^) + e, 

as n— >» , where we have used Eq. (14) and applied an 
argumeiu similar to that in Lemma 3. Asymptotically, 
the probability is factorized, whence the statement D 
To prove the convergence we combine in what follows 
the above lemma and Eq. (13). The idea is that Ihc points 
with top layer ranks have also small ranks in the radial 
components. On the other hand, conical extrcmality of 
the points with small layer ranks is determined by their, 
almost independent, spherical components. 



Introduce the random variables 

...,X';'}-0>, k^l n, 

which count the X,- 's in the norm -decreasing order until 
the first k layers having been filled. Clearly, 
yw ^ -j^t) ^ 7^t+o_ Denote S" the product of infinitely 
many spheres, and set 

/^"'(z) = 0; P'\z) - min{/- : {S, n {zi Zj})-k}, 

V>«'(z) = #{/ : 7^'-" (z) <j « f<*>(z), zj e S\S.}. 

where z - (zi, zi, . . .) G S* and inf = ^. For i ^j 
the set 

{z G S' : V>*"(z) -;, f<*'(2) = i } 

is a finite-dimensional cylinder in 5". 

Denote Z- (Z'",Z'^', . . .) the sequence with iid 
components distributed according to p, 7^* = 7^*'(Z), 
V*" * t^'*'(Z). It foltows from the definition and condi- 
tion (iii) of Sec. 2 that r<*', A- 1,2. ...is a .strictly 
increasing sequence of finite stopping times with 
respect to Z'", Z"', . . . 

Theorem 2. Axsimie (i)-(iv), a = 0,am} p(()S, U ^5.) 
= 0. Then for any t = 1 ,2, . . . 

(v'*„\ n\ . . . .v>;>. 7<i') ^ (\/<'>, 7^", .... v", p% 

Proof. Fit integers v, vY,tu...,h = t satisfying 

< li < . . . < fji and « Vi « ti-t,., for / = I it. We 

need to prove that 



lim P{V"i> = v,.7l;'-ri; i^k} = 
P{V<«=Vi,r'''' = /,;i=^Jt}. 

We endow 5' with the product measure p' and the 
Euclidean metric. Define 



t> = /95. U (?5^S={(z, z,)G5': 

{2t Z,}nD -0}, 

^={(S z,)G5': i^%„...,z,) = 

i-/. 7^'^(: ,2,) = ',;/^ A}. 

The definition of .^ is correct due to the cylindrical 
property. It is easy to see that Sd is compact, jjAS) is 
open and. by the assumption, p\2)-0. It follows. 
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pXsd) = p'i.^^). For any S there exists Jiis with the 
properties: 

^iCsi^, p(jz^)-p(^j)<S, dist(^a.®)>0, 
p\Ssis)^0. (16) 

To prove this, take ^^iaEsi^ ;dist (a,^(^ 
®})>^}. then 'i^fl is an open set, increasing to 
jAS? as eiO . We have pXisi^)\%) < 8 for 
sufficiently small d. On the other hand, d'^e C 
{a eS':dist(fl,^(,sA2!)) = fl}, these sets being dis- 
joint for different d. Hence the set of the values of 6 
with pXS^s) > is at most countable. Select an appro- 
priate and set sis- ^g ■ 

We derive from Eq. (16) with the help of some topo- 
logical considerations that for sufficiently small € 

U (Z/ + S.)ncone(D)-0 (z, z,) & si^. {H) 

t* / 

Assume now that the compound event 

(Z^i' Z';i)e^,;eR'«>^r" .•= 1 k (18) 

occurs. We show next that in this case 

n^ = ';, V<,"-v, 1=1 k. (19) 

Let Q be an clement of the finite algebra of spherical 
sets generated by S* and S^ The following equivalence 
holds: 

X=^Lx^Gcone(Q)«Z'^iGGforl ^i^t,i<j^n. (20) 

Indeed, note first that <9j2 C D. By (17), Z'j" S Q implies 
Z';'-i-fi,Ccone(e). From Eq. (18) we have also 
X'^'+fl„i,iCcone(G). But -X'JeB^yi thus X'i'- 
X^ E. cone (Q). Use Q' instead of Q to prove the 
reverse implication. 

The definition of J;^ and Eq. (18) yield Z'*' G S^, 
/ = 1 , . . . , it . Setting e = 5+ in Eq. (20) we have X'S'- 
X'ifEK,ti<j^n. Therefore, 



i''"" x';i} n ( U i?""(^.)) = 0. 



{X. 



Let f^-i <;< f, and Zii' e 5 . Setting Q~S. in Eq. 

(20), we have {Xi^'^ X^'„'} C {X^ + K). Setting 

2 = 5, we have further {X'?', X'i?', ■ . .X^'-'} 
e (XV^ + A-) . That is. X^^ ^ U„ , , if^'"(X). 

Let fj.1 < j < f; and Z^E So . Substituting Q-So into 
Eq. (20) we get X^^-X";' € cone (So). ; + 1 ^ p 'S n, 
together with So - -So and 5^ fl 5,. = this yields 
{XP*" X'„"'> n {K+X^^) = 0. For Q = S^^ and 



pe{l ;-l}\{fL,/2 Jm} we have XV € 

{K + X';;'). Similarly, for p £ {/i.fj, ..../;.,} we have 

{x'iU'?',...,x'"-''}cxtU/:. 

Thus in this case X!!'' e ,S?'-"(^.). 

In the same manner, Z'i' G S+\S. implies X'i' G 
=Sf<^"(5i!',). 

Summarizing, if Eq. (18) holds then 
^\3e„ ) - {X'; '://.,<;« . 2" ^ 5.N5_}, whence 
Eq. (19). 

Now from Eq. (13) and Lemma 5 (recall that t-tt) 

P{(Z':' Z"*') G ,s/,. eK'i' > Rf"; 

»-l,...,/t}-^p"(^*). 

Recalling the definitions of M and .s/^ wc get 
liminfP{V"p-v,.ri>=/,; i^k}> 

Take 5= 5(vi, . . . , v*;/!, . . . ,1*) with 

25(vi, . . , , vj; f,, . . . , f() - /3 and choose a diagonal 
subsequence of the values of n to get the convergence of 
the probabilities in the left-hand side. Recalling that 
probabilities sum to one, we derive Eq. (15) by setting 

)3^on 

Convergence in mean does not require additional 
restrictions, as shown next. 

Theorem 3. Under the assumptions of Theorem 2 

Proof. It is sufficient to consider only the case k— \. 
Denote by /,''' and /'*' the indicator fijnctionsof the 
events {X'i' ei?"(af,)} and {Z"i e S\S.. /^r"'}, 
respectively. Clearly, 

v„"' = /'j|+,../';',v'"- /"I + /'=! + ... 

By an argument similar to that used in Theorem 2 we 
show that 

(/l^',...,/':')^(;"' /I"") m-\X... (21) 

Choose y, satisfying np„—>\ , where A > 0, p„ = 
l-fJL{ByJ. The random variable Ar-#({X,,. . . ,X,} 
n By^) has binomial distribution with parameters (n ,p„). 
By Eq. (6), 

E(/,'**" + . . . +/';') = E(^"(S«;) n b^,) « e-'v '. 

(22) 
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Fix m and write the expectation as 

EV<^' - E(/'i' + . . . /':') = E(/'^' + . . . /':') + 

E(/!"^'|+.../i;'|) 1 (,v^„ }+E(/r"+... /';') I {.v^«>+ 

E(/r" + ... /'„"') l<.v<.,. 

The first term converges by Eq. (2 1 ): 

E(/'ii+ . . . /':')->£(/!" + . . . /""I). The first and the 
third terms arc estimated by Eq. (22) as 

E(/r" + ... /'„"') l<,v^.,+ E(/r" + ... /';')l(,v<„} 

^E(/r"+... +/'."') ^e'V. 

Since A' is binomially distributed, we have for the 
second term 

E(/r " + . . . /'?') lcv^„}<E(A^ Itv..})^ 
AP{WA>m-l}, n^x 

where Nn is a Poisson random variable with parameter 
A. Selecting A and then m sufficiently large, we prove 
lim sup,^« EU'*' ^ EV<". 

The inverse inequality involving lini inf follows from 
the com-crgcnce in distribution D 

It is not hard to find the limiting distributions of the 
V'^'s. Note first that 

{v^'K r% (v<^', T^^>-p'\ . . . 

are all iid, therefore it is sufficient to consider only the 
first pair. Clearly jT*'* is geometrically distributed with 
parameter p{S^). The probability law of V" is found 
from the following scheme: throw down the iid points 
Z^'', Z'^', ... in S according to the probability law p 
until the first point falls into S^ , then count all the points 
falling into S\S.. To make this precise denote 

Pq = p{St,), p- = p{S*), p- = p(S.), p. - p(5+) 



(thuspo + p +P*-P- = 1). The joint distribution of V'" 

aixl T*" is this: 



p{v<'> = j,T<" -_,} - p{{z"' z^'^yns, =Q. 

Z^'> G 5..#({Z'" Z"} n (5N5.)) = t } - 

p{{zi" z^'^yns^ =0, 



z^'^ G SAS , #«z") z^'^y n is\s.)) - i-i } + 

P{{Z"i, , , . , z>>-"} n 5. - 0, Z"' G s^, 

#({z"i zi"i}n(5^.)) = i} = 

P<#«zi'i,...,zi>"}nSo) -i-i, 
#({z'", , . . , zi^'i} n (s\s,)) ~j-iyx 
p{z^'i e 5»\S-} + P{#({Z"', .... z'^'i} n So) - 1. 
#({Zi",. . . , z"^'! } n (5\s.)) - j-i-i }P{zi'T e 5, } - 

where / > 0,7 S: I -jjvlj S: i'. Summing overj we arrive 
at the limiting distribution of points in the itth layer. 

P{V<*'-0}--— 2^ , 



P(K('^ = ,-}= P""'t'-P-^P;, / = i.2, 
'^ ' (1-p. + Pi)'*' 



If the cone satisfies K fl -/T - (or, more generally 
p(5. n 5.) = ) then p^^^O and V<" is geometrically 
distributed. A little additional work is needed to find the 
expectation; 



EV'*' ■■ 



\-2_ 



(23) 



Example. Assume that the radial tail is slowly vary- 
ing and p is the uniform spherical measure. 

For a: = r; we have p^-P- = 2", and Eq. (23) yield 
EV'i* — > 2''-l. In particular, the mean number of Pareto 
points in two dimensions converges to 3. 

Taking the complement to the negative orthant. wc 
havep., =p_= l-2^andEV^„"->(2''-l)-'. Intwodimen- 
sions. the probability that the sample has the double 
maximum tends to 1/3. 

Appearing of inverse numbers in the abo\« example is 
a general phenomenon. We write further V'i' (K) to 
emphasize the dependence on the cone. 

Theorem 4, Under the assumptions of Theorem 2 

lim EV*(A:)EV"f'(-/i:0-l, 

provided one of the numbers p^ or l-p. is positive. 

Proof. This follows from Theorem 3, Eq. (23), and the 
formulas P-(-K'y = i-p,(K), p^-A'O = i-P-{K) D 
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Remark. Given a binary relation, say 5?, on a sam- 
pling space, and a random sample ^„, there are two 
natural ways to define the "Jtth extremes" ofTC, : (1) 
sample elements X, which are in CA with all other sample 
elements with the exceptbn of some k-l points; or 
(2) the elements Xi such that there are exactly k-l 
sample points which are in the relation with X,. In the 
theory of partially ordered sets extremes (k = I) of the 
first type are called the greatest p<Mnts, of the second 
type — maximal [4]. This is best illustrated by the 
natural partial order of R"*: total maximum is the great- 
est point, while Parcto set consists of maximal points. If 
the binary relation 5? is generated by a cone AT, as 
mentioned in Introduction, then the X' -extremes are 
maximal points, while the —K' -extremes are the greatest 
points w.r.t. II. Baryshnikov [3] has proved that the 
asymptotic upper ixjund for the prixluct of expectations 
of the numbers of the extremes of both types is at most 
1, for any fixed S? and k. Theorem 4 shows that this 
bound is sharp. 

Remark. Normal multivariate distributions can be 
viewed as the case of fast decreasing radial tails, « = «, 
The mean number of conical extremes demonstrates 
typically the following behavior: for any k, EV' 
infinitely grows if K is contained in a half-space, and 
tends to zero if K contains a half-space [10,1 1]. 
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